POLYNOMIAL OPTIMIZATION WITH REAL VARIETIES 



JIAWANG NIE 

Abstract. We study the optimization problem 

min f(x) s.t. h(x) = 0, g(x) > 

with / a polynomial and h, g two tuples of polynomials in x G R™ . Lasserre's 
hierarchy is a sequence of sum of squares relaxations for finding the global 
minimum f m in- Let K be the feasible set. We prove the following results: i) If 
the real variety Vm(h) is finite, then Lasserre's hierarchy has finite convergence, 
no matter the complex variety Vc{h) is finite or not. This solves an open 
question in Laurent's survey 7 ]. ii) If K and Vr(/i) have the same vanishing 
ideal, then the finite convergence of Lasserre's hierarchy is independent of the 
choice of defining polynomials for the real variety Vr(/i). iii) When K is finite, 
a refined version of Lasserre's hierarchy (using the preordering of g) has finite 
convergence. 



1. Introduction 
Consider the polynomial optimization problem 

{fmin := min f(x) 
s.t. hi{x) =0(i = l,...,mi), 
9j(x) > 0(j = l,...,m 2 ), 

where / and all <?;, hj are polynomials in x 6 R n . Let K be the feasible set of (jl.ip . 
A standard approach for solving globally is the Lasserre 's hierarchy of sum of 
squares (SOS) relaxations [3]- We first give a short review about this. Let M.[x] be 
the ring of polynomials with real coefficients and in variables x := (sci, . . . , x n ). A 

polynomial / is SOS if there exist /i, • • • , /fc G M[x] such that / = ff H h A 

subset / of M.[x] is an ideal if / + / C / and / • M.[x] C /. Denote h :— (hi, . . . , h mi ) 
and g := (gi, . . . ,g m2 )- The tuple h generates the ideal /iiR[a;] + • • ■ + /i mi M[a;], 
which is denoted by (hi, . . . , h mi ). The 2fc-th truncated ideal generated by h is 



mi 



i=l 



each fa € R[x] 
and deg(0 i /i i ) < 2k 



(h) 2k := 

and the fc-th truncated quadratic module generated by g is (denote go = 1) 

I " l2 _ 

Qk{g) ■= I ^o-jgj 



each o-j e R[cc] is SOS 
and deg^gj) < 2k 
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The union Q(g) := Ufc>o^ fe (5) ^ s cane d the quadratic module generated by g. 
Lasserre's hierarchy for (jl.ll) is the sequence of SOS programs (k 6 N is called a 
relaxation order): 

(1 2) { ^ k := maX 7 

[ -> \ s.t. /- 7 = + cr, <f)E (h) 2k , ae Q k (g)- 

The SOS program (11. 2p is equivalent to a semidefmite program (SDP) [3]. 

Next, we describe the dual optimization problem of (|1.2[) . Let y be a sequence 
indexed by a := (ai, . . . ,a n ) G N" (N is the set of nonnegative integers) with 

|a| := ai H + a n < 2k, i.e., y is a truncated moment sequence (tms) of degree 

2/c. Denote by ^2k the space of all tms' whose degrees are 2k. For convenience, 
denote dj := \deg(gj)/2~\ (\a] is the smallest integer that is not smaller than a), 
x a := x" 1 ■ ■ ■ x% n and 

[x]t ■■= [l x x ■ ■ ■ x n x\ xix 2 ■■■ x\ ■■■ x^] T . 
For each k > dj, expand the product gj[x]k-dj [xj-dj as 

\a\<2k 

and we define the localizing matrix L g k -\y) as 



*|<2fc 



For go = 1, Mfc(y) := 4 (y) is called a moment matrix. The columns and rows of 
Lgj(y) are indexed by vectors a <E N™ with |a| < k — dj. The dual optimization 
problem of (TQ|) is (cf. [IHH]) 

f # := pi? f) 

( L3 ) S s.t. 4?(J/) =0(t= l,...,mi),J/o = 1, 

I 4f(y)h0(i = 0,l,...,m 2 ). 

In the above, X >; means the matrix X is positive semidcfinite. 

Let f m i n , fk, /£, respectively, be the optimal value of (11.11) . (|1.2[) and (II. 3[) . It 
is known that < < / m i„ for every fc. The sequences {/fc} and {/^} are both 
monotonically increasing. If K has nonempty interior, then (|1.3[) has an interior 
point, (jl.2p achieves its optimal value and f£ = fk, i.e., there is no duality gap 
between (|1.2[) and (|1.3|) (cf. [3]). Under the archimedean condition (there exists 

> such that N—x T x € (h)+Q(g)), Lasserre proved the asymptotic convergence 
fk —> fmin as k — >• oo. The proof uses Putinar's Positivstellensatz [16] . We refer to 
Lasserre's book [3], Laurent's survey [7] and Marshall's book [TU] for the work in 
this area. 

When fk = fmin for some k, we say Lasserre's hierarchy has finite convergence. 
An appropriate criteria for checking finite convergence of {fk} is fiat truncation, 
as shown in [15] . For the tuple h = (hi, ... , h mi ), define the complex and real 
algebraic varieties respectively as 

(1.4) V c (h) = {x e C" : h{x) = 0}, V M (h) = V c (h) n M n . 

When the complex variety Vc(h) is a finite set, Laurent [3] proved that {/fc} has 
finite convergence to fmin- When the real variety Vr(/i) is a finite set, Laurent 
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[Jj Theorem 6.15] proved that {/?} has finite convergence to fmin- In the case 
that Vk(/i) is finite but Vc(h) is infinite, it was unknown whether {fk} has finite 
convergence to f m %n or not. Indeed, Laurent [7J Question 6.17] asked: 

Does there exist an example with |Vfc(/i)| = oo, |Vt(/i)| < oo and 
where f k < f min for all kl 

This question was also asked by Laurent in the workshop Positive Polynomials 
and Optimization (Banff, Canada, 2006), and remained open since then, in the 
author's best knowledge. Semidefinitc relaxations are also very useful for solving 
zero-dimensional polynomial systems. We refer to 0[8]. 

Our first main result is to give a negative answer to the above question. We 
prove that if Vr(/i) is finite then fk = fmin for ah k big enough, no matter Vc(h) 
is finite or not. This is summarized as follows. 

Theorem 1.1. Let f, h\, . . . , h mi , gi, . . . , g m2 be polynomials in M[x\. Let fk be the 
optimal value of with order k, and f m in be minimum value of il.l]) . If the 

real variety Vr(/i) is finite, then fk = fmin for all k big enough. 

The real variety Vs_(h) can be defined by different sets of polynomials, e.g., it 
can be defined by a single equation like 



Suppose h' = (h[, . . . 7 h' r ) is a different tuple of polynomials such that Vr(/i') = 
\^j(/i). Then (11. ip is equivalent to 



Like (h) 2 k, we can similarly define the truncated ideal (h') 2 k- Then the Lasserre's 
hierarchy of SOS programs for (|1.5p is 



Similarly, we also have f' k < / mm for all k. The following two questions are natural 
about the two sequences {fk} and {/(.}: 

• If {fk} has finite convergence to f m i n , does {f' k } necessarily have finite 
convergence to / mm ? 

• If {fk} has no finite convergence to f m in> is it possible that {f' k } has finite 
convergence to / mm ? 

They were studied very little in the literature. 

When the real variety Vr(/i) is finite, by Theorem ll.il the above two questions 
are solved: the finite convergence of Lasserre's hierarchy is independent of the choice 
of defining polynomials for the real variety Vr (h). When Vi(ft) is infinite, do we 
have a similar result? Indeed, this is true under a general condition on Vr(/i) and 
K (K is the feasible set of (|1.1[) ). The vanishing ideal of K is 



h\(x) H h hi 



(x) = 0. 



(1.5) 



min f(x) s.t. ti(x) = 0, g{x) > 0. 



(1.6) 




I(K) := {p e R[x] : p{u) = OVu £ K}. 

The vanishing ideal of the real variety Vk(/i) is then 

I(V R (h)) := {p G R[x] : p(u) - OVu G V R (h)}. 

The ideal /(Vm(/i)) is also called the real radical of (h) (cf. pQ). 
Our second main result is the following theorem. 
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Theorem 1.2. Let h! = {h' 11 . . . , h' r ) be a tuple of polynomials in WL[x] such that 
Vin(h) = Vm(h'), and /min be defined as above. Suppose I(K) = I(Vm(h)). 

Then, the sequence {fk} has finite convergence to f m i n and if and only if {f' k } has 
finite convergence to f m in- 

In Theorem II. 2 1 the condition I(K) — /(Vr(/i)) implies that if a polynomial p 
identically vanishes on K then it also identically vanishes on Vr(/i). It essentially 
requires that the feasible set K and the real variety Vr(/i) have the same Zariski 
closure. This is often satisfied. 

We would like to remark that there does not exist a similar result like Theo- 
rem 11.21 for the case of inequalities. That is, the choice of inequality constraining 
polynomials gj might affect finite convergence of Lasserre's hierarchy, while the 
feasible set K is not changed. For instance, consider the problem 

min 1 — x 2 s.t. 1 — x 2 > 0. 

Clearly, the Lasserre's hierarchy for the above converges in one step, and the prob- 
lem is equivalent to 

min l-x 2 s.t. (1 - a; 2 ) 3 > 0. 

However, the Lasserre's sequence {fk} of lower bounds for the above new formula- 
tion does not have finite convergence. Indeed, there exists a constant C > such 
that fk < -Ck~ 2 for all k. This is implied by Theorem 4 of Stengle [Hi] . 

This paper is organized as follows. Section [2] is mostly to prove Theorem 11.11 
Section [3] is mostly to prove Theorem 11.2) Section |4] proves that if only the feasible 
set K is finite, then a refined version of Lasserre's hierarchy has finite convergence, 
which uses the preordering of the tuple g. 

2. Optimization with finite real varieties 
This section is mostly to prove Theorem ll.il We begin with a useful lemma. 

Lemma 2.1. Let p,q G M.[x] and L C M.[x] be an ideal such that p 21 + q E L for an 
integer £ > 0. Then, for all 

If 1- 

the univariate polynomial s c (t) := 1 + t + ct 2e is SOS, and, for every e > 0, 

p + e- [es c (p/e) + ce^q] = -ce^ip 2 ' + q)eL. 

Proof. For all c > 0, the univariate polynomial s c (t) is convex in t over the real 
line R and s' c (t) = 1 + 2£ct 2e ~ 1 . The polynomial s c has a unique real critical point 

£ := (2^)^. Note that 

It can be verified that s c (£) > if and only if c > c$. So, when c > cq, the 
univariate polynomial s c is nonnegative over R (because s c (£) > 0, s' c (^) — and 
s c is convex), and it must be SOS (cf. [E]). Clearly, we have 

p + e ~ [es c (p/e) + ce^q] = -ce^ip 21 + q). 

The proof is completed by using the condition p 21 + q £ I. □ 
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Theorem 11.11 can be proved by using Lemma 12.11 

Proof of Theorem \l.l\ Since Vr(/i) is finite, we can write Vr(/i) = {tti, . . . , u^} for 
ui, . . . , un £ K™. Let (fx, . . . , ifN £ M.[x] be the interpolating polynomials satisfying 



if i ? j, 

1 if i = j. 

For each u;, if f(u. t ) - f mm > 0, let m := (/(«*) - / min )^ If - fmin < 0, 

then at least one of gi(iti), . . . ,g m2 { u i) is negative, say, Qj^Ui) < 0, and let 

fyUi) fmin\ 2 

Let o\ := a\ + ■ ■ ■ + a at. Clearly, o\ £ QnAq) f° r some N\. The polynomial 

J '■= f ~ fmin — 0~1 

vanishes identically on Vr(/i). By Real Nullstellensatz (cf. [TJ Corollary 4.1.8]), 
there exist an integer I > and an SOS polynomial o~2 £ M.[x] such that 

f 2e + a 2 e (h). 

Let c > be a constant satisfying Lemma [2~T1 For e > 0, let 

a e := es c (//e) + ce 1 "^ + oi. 

By Lemma 12.11 the polynomial s c (f/e) is SOS and its degree is independent of 
e > 0. So, if Ni > is big enough, then er c G QN^g) for all e > 0. Note that 

/ - {fmin - e) = / + C + ^ . 

By Lemma HHl we have 

:= / + e + ffi - a e = -ce 1 " 2 ^ + C7 2 ) G (ft). 
So, there exists ./V2 > such that cf> e £ (h)2N 2 f° r an e > 0. Note that 

/ - {fmin - () = (f>€+ O e . 

If k > N$ :— max(7Vi, N2), we have cr £ £ Qk{g) and (f> e £ (K)2k for all e > 0. So, 
fk > fmin - e for all e > and then f k > f min , if k > N 3 . Since / fc < f mm for all 
A:, we get f k = f min if k > N 3 . □ 

We present some examples showing the basic ideas in the proof of Theorem 11.11 

Example 2.2. Consider the optimization problem 

min f(x) := X1X2 

s.t. h(x) := {x\ - l) 2 + (x\ - l) 2 = 0, 
g{x) := xi + X2 — 1 > 0. 

The real variety Vk(/i) = {(±1,±1)}, and the feasible set consists of the unique 
point (1,1). Clearly, f min = 1 and every f k < 1. Let 

CT i : = \( Xl + x 2~ ~ a; 2) 2 G ^2(3), 

/ := x x x 2 - 1 - (Ti = - [(x? - l)(;ri - a; 2 - 1) - (x 2 . - l)(iCi - x 2 + 1)] • 
Letting 

^2 = J ((z 2 - l)(xi - x 2 + 1) + (x\ - \){x x - x 2 - l)) 2 , 
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we have 

P + (72 = _ if + (4 if) (X1 = x f ± 1 G We 



Note that 

xix 2 - (1 - e) = / + e + <7i. 

For e > 0, let 

Clearly, we have tr e € Qz{g) for all e > 0. One can verify that 

e := - (1 - e) - <r e = -~r(f 2 + 0-2) € (fc)e- 

4e 

This shows that fk > 1 — e for all > 3 and for all e > 0. Since each /& < 1, we 
can get fk = 1 for all k > 3, and the Lasserre's hierarchy converges in 3 steps. □ 

Example 2.3. Let / e K[x] be such that /(0) = 0. Consider the problem 

min fix) 

s.t. h(x) := x\ d H h x 2d = 0. 

Clearly, f m i n — and < for all fc. There is no inequality constraining polyno- 
mials, and we can think that g — 0, as in (jl.ip . The objective / is constantly on 
Vr(/i) = {0}. We can write / as 

/ = Xlfl H l-a^n/n, /l, ••->/« €M[x]. 

There exists A > such that the form 

A(i? d + --- + ^)-(t 1 + ... + t n ) 2d 

in (ti , . . . , t n ) is SOS. This is because t\ d + ■ ■ ■ + t^f lies in the interior of the cone of 
SOS forms in n variables and of degree 2d (cf. [TTJ Proposition 5.3]). By replacing 
each ti by Xifi in the above, we know that 

<p := A((x 1 / 1 ) M + • • • + ix n f n ) 2d ) - f 2d 

is an SOS polynomial in x. Clearly, the polynomial 

V := A [ {xf + ■■■+ xl d ) (f 2d + ■■■ + f n d ) {i Xl .hf d + ■■■ + ix n f n f d ) 
is SOS, and it holds that 

f 2d + <p + V = A« + ■ ■ • + x 2d )iff d + ■■■ + f n d ) G (h). 
Suppose deg(/) = r. Let 

„ :=e ( 1+//e+ i. (/A H + i. e .-^ + ,). 



Then, a t G <5dr(0) for all e > 0, by Lemma \2. II We also have 

f + e = a t +4> c , where <£ £ := -^ e 1 - 2i (f 2d + ip + rf). 
Note that (f> e G (h)2dr for all e > 0. Like before, we can get fk = for all k > dr. □ 
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The ideal (h) is real if (h) = I(Vk(h) (cf. [TJ Section 4.1]). When (h) is real and 
Vsi(h) is finite, the optimal value fk of the SOS program (|1 .2|) is achievable for all k 
big enough. This can be shown as follows. Let <j\ be from the proof of Theorem 1 1 . 1 1 
We have seen there that / = / — / m , n — u\ identically vanishes on Vgfjx). If (h) is 
real, then / G I(Vg.(h) = (h) and / - f min = a\ + f, which implies that 7 = f min 
is feasible in fj 1 . 2 j) if is big enough. 

However, if the ideal (h) is not real, then the SOS program (|1.2j) might not 
achieve its optimal value fk for any order fc. For instance, consider 

min x\ s.t. x\ + x\ H + x^ = 0. 

For any G M[x], the polynomial tp = Xi — {x\ + H h can not be SOS 

(because <p(0) = 0, V</?(0) 7^ 0, and can not be a minimizer of if), so (|1.2|) does 
not have a maximizer. However, from Example 12. 3[ we know fk = for all /c > 1. 



3. OPTIMIZATION WITH GENERAL REAL VARIETIES 



This section is mostly to prove Theorem II .21 We first prove a result that similar 
to Theorem 1 1.21 by using generators of the vanishing ideal L(V R (h)). 
Let h{ ad , . . . , h r t ad be a set of generators for I(Vr(K)), i.e., 

I{V v ,{h)) = {h™\...,hl ad ). 

Denote h rad = {h\ ad , h r t ad ). We define the truncated ideal (h rad ) 2k in the same 
way as for (h) 2k . Clearly, the problem (|l.lj) is equivalent to 

{min f{x) 
s.t. hl ad (x)=0(i = l,...,t), 
gj (x)>0(j = l,...,m 2 ). 

The Lasserre's hierarchy of SOS relaxations for (|3.1j) is 

jrad ._ max ^ 

s.t. f- 1 = <f> + a, (h rad ) 2kl a eQ k (g). 



(3.2) 



We also have ff. ad < f m in for all k. 

Theorem 3.1. Let f m i n and K , respectively, be the minimum and feasible set of 
fZZZP- Suppose I(V R {h)) = (h[ ad ,...,h r t ad ) and I{K) = I(V R {h)). Let f k (resp., 
fk ad ) be the optimal value of (resp., i3.S\) ). Then, the sequence {fk} has finite 
convergence to f m in and if and only if {fjl ad } has finite convergence to f m in- 

Proof. First, we assume that has finite convergence to fmin, say, /™ d = f m i n 

for all k > N\. Note that K is also the feasible set of (|3.ip . By the condition 
that I(K) = (h rad ), we know the quotient set Qk(g)/(h rad ) is closed for all k (cf. 
Laurent (3 Theorem 3.35] or Marshall Theorem 3.1]). Let {(7,,^,^)}^ be 
a sequence such that each triple (7^,^,(7;) is feasible for (|3.2[) with k = N\ and 
H -> f m in- Clearly, each / - 7, € QN 1 {g)/{h- rad ) and / - 7» f - f mm . Hence, 
/ - fmin G QN l {g)/{h rad ), i.e., there exists 0* G (h rad ) and a* G Qni(jj) such that 

/ - fmin — 4>* + 0* ■ 

Let N 2 > iVi be such that cj>* G (h rad ) 2N2 . Then, (f min ,<t>*,cT*) is feasible for §3$ 
with k > JVj. Hence, (|3.2[) achieves its optimum for all k > A^. For every e > 0, 

/ - {fmin - e) = (0* + e) + (7*. 
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Since 0* G (h rad ) = I{V R {h)), </>* identically vanishes on Vm(h). By Real Nullstel- 
lensatz (cf. [T| Corollary 4.1.8]), there exist an integer I > and an SOS polynomial 
a € such that 

(<f>*) 2e + ae (h). 

By Lemma HOI for all c > the polynomial 

2A 

l + -+c|^-| \+ce 1 - 2e a 



is SOS. Let N 3 := max{N 2 ,tdeg{(f>*), [deg(a)/2]), then for all e > 
(T e := e ( 1 + — + c f — ) ) + ce 1 " 2 ^ + a* G Qn 3 (g), 



c 



<Pe ~ (/ - (fmin - e)) - a 6 = -ce^ 2e {{^ ) 2e + a) G (h). 
Let 7V 4 > N 3 be such that (<f>*) 2f + a e (ft>2jv 4 - Then, for all e > 0, 

/ - {fmin - e ) = °"e + (/>e, cr t eQ Ni {g), <p e G {h)-2N A - 
Like before, we can get fk = fmin for all k > N4,, i.e., {fk} has finite convergence 

^0 fmin • 

Second, assume that {fk} has finite convergence to f m i n , say, fk — fmin for all 
k > Mj.. Then, for every e > 0, there exist </> c € (/i)2Mu o"e S Qmi{9) such that 

/ - (/ram - e) = (f) t + a e . 

Clearly, every (f> € vanishes on Vn{h), and thus belongs to I{Vk{h)). By (h rad ) — 
I{Vm{h)), we have <j> t £ (h rad ). Note that deg((^ e ) < 2M 1 for all e > 0. Then, there 
exists M2 > such that 

</> e G (h rad ) 2 M 2 for all e > 0. 

(This can be implied by Corollary 8.3 of Dube [2] or Proposition 1 of Mayr and 
Meyer [12].) Thus, we have f[ ad > / mm - e for all fc > M 2 and all e > 0. This then 
implies /™ d = f m in for all fc > Ma, i.e., has finite convergence to / m i n . □ 

Theorem 11.21 can be proved by using Theorem 13.11 

Proof of Theorem[TE Let h rad and f r k ad be as in Theorem O By Theorem O 
{fk} has finite convergence to f m in and if and only if has finite convergence 

to fmin- For the same reason, since (jl.ll) is equivalent to (|1.5p . {/£} has finite 
convergence to / m j n and if and only if {fl" ad } has finite convergence to f m in- This 
shows that {fk} has finite convergence to f m in and if and only if {f' k } has finite 
convergence to f m in ■ D 



A direct consequence of of Theorem 11.21 is that we can reduce the number of 
equality constraints in polynomial optimization, while the finite convergence of 
Lasserre's hierarchy is not changed. As is well known, every real variety can be 
defined by a single equality. Let 

ft"(x) ■^h\{x) + --- + hl li {x). 

Then, (jl.lj) is equivalent to 

(3.3) min f{x) s.t. h sq (x) = 0, g{x) > 0. 
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The Lasserre's sequence of SOS programs for (|3.3[) is 
(3.4) 



:= max 7 s.t. / — 7 = <f> + a 



If I(K) = /(Vr(/i)), by Theorem II .21 we know {/&} has finite convergence to f m i n 
and if and only if {f^ q } has finite convergence to f m in- We show an example of 
this. 

Example 3.2. Consider the optimization problem: 

, . J min f(x) := x x x 2 x 3 - 2x 3 

\ s.t. h s i(x):=(x 2 -x 2 ) 2 + (xl~x 3 ) 2 = Q. 

It has no inequality constraints, and we can think that g — 0. Its feasible set is 
a curve that can be parameterized as (x\,x\,x\). The minimum f m i n = —1 is 
achieved at the point (1, 1, 1). We show that the Lasserre's sequence {f^ 9 } for Q3.5P 
has finite convergence. Clearly, we have f^ q < —1 for all k. Let a* :— (x\ — l) 2 , 
which is SOS, and 

(/)* := (x\ - 2)(x 3 - xl) + XiX 3 (x 2 - x\). 
Then we have / + 1 = a* + (j>* and (<fi*) 2 + a = h sq ip where 

a = (x 1 x 3 (x 3 - xf) - (x\ - 2)(x 2 - x\)^j , 
xp = x\x\ + (xl - 2) 2 . 

For each e > 0, let 

*.:=e(l + £) +-t a + °*- 
Clearly, a t 6 Qe(0) for all e > 0. From the identity 

f + l + e = a c + ^h s ", 

we can get fjl 9 = — 1 for all k > 6. □ 

We show an application of Theorem 11.21 in gradient SOS relaxations for mini- 
mizing polynomials [13j . Consider the optimization problem 

(3.6) min f(x). 



If (|3.6|) has a minimizer, then it is equivalent to 

(3.7) min f(x) s.t. Vf(x) = 0. 



It was shown in [14] that the Lasserre's hierarchy for (|3.7j) always has finite con- 
vergence. Clearly, (|3.7[) is equivalent to 

(3.8) min f(x) s.t. \\ Vf(x)\\ 2 2 = 0. 

The advantage of (|3.8j) over f|3 . T|) is that (J3T8J) has a single equality constraint. By 
Theorem II .21 the Lasserre's hierarchy of (|3.8|) also has finite convergence. 
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Example 3.3. ([3j[T3]) Consider the polynomial optimization problem 

min f(x) := x 2 x 2 (x 2 + x 2 , — 1). 
xeR 2 

The minimum f m in = —1/27 is achieved at (±l,±l)/\/3. The standard Lasserre's 
hierarchy {/&} for the above does not converge to / m j„. We have 

df/dxi = 2x x x 2 2 {2x\ + x\ - 1), <9//<9:e2 = 2x\x 2 {x\ + 2x\ - 1). 

This optimization problem is equivalent to 

min f(x) s.t. \\Vf(x)f 2 = 

igR 2 

where ||V/(a;)||| has the representation 

4x^x1 (x^xj + x\ - l) 2 + x\(x\ + 2x\ - l) 2 ) . 

Let <j\ :— 3(x 2 x 2 — 1/9) 2 and / := / + 1/27 — a\, then / vanishes identically on 
Vr(V/). This can be verified by the identity 

f 2 + s = ||V/|| 2 ^ 
where s, ^ are SOS polynomials given as follows: 

a = x\ — 1/3, b = x\ — 1/3, 

Sl =xlxl(x 4 2 {2a + b) 2 + x\{a + 2b) 2 ^, s 2 = 4(a + 6) 2 (a 2 + b 2 ) + a 4 + 6 4 , 

s = ^( Sl (a 2 + 6 2 ) + .x 4 ^ S2 ), V = + ^)(a 2 + 6 2 ). 
For all e > 0, we have 

ff e :=e(l + //2e) 2 + £+a 1 € Q 8 (0). 

/-(-l/27-e)=<r e + &, where </> e := -1||V/|| 2 ^. 

4e 



Note that 



We have ^ c € (|j V/|| 2 )i6 for all e > 0. Let f^ rad be the optimal value of the fc-th 
Lasserre's SOS relaxation for (|3.8p applied to this example. Like before, we can get 
/f ad = -1/27 for all k > 8. □ 

4. Optimization over finite semialgebraic sets 

In this section, we consider the optimization problem (ll.ip whose feasible set 
if is a finite set while the real variety Vm(h) might not. To apply Theorem ll.il a 
natural idea is to introduce new variables z\ , . . . , z m2 . Then the feasible set K can 
be equivalently defined by the equations 

h(x) = 0, gi{x) - z\ = • • • = g m2 (x) - z 2 l2 = 0. 

Clearly, if is a finite set if and only if the above equations have finitely many solu- 
tions in l n+ "' 2 . If if is finite, by Theorem 11.11 the Lasserre's hierarchy has finite 
convergence if we use the above equivalent polynomial equalities in both x±, . . . , x n 
and Zi,...,Zm a . However, this approach introduces new variables zi,...,z m2 , 
which typically make the resulting SOS relaxations very expensive to solve. To 
get a finitely convergent hiearchy of SOS relaxations that only uses the original 
polynomials in x, we typically need stronger relaxations than (jl.2[) . 
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(4.1) 



Let Prk(g) be the fc-th truncated quadratic module generated by the set of all 
possible cross products: 

9l, •••) ffm 2 ,fflff2, g mi -ig mi , 3l52 • • • 5m 2 - 

The set Prk(g) is also called the fc-th truncated preordering generated by g = 
(<7i, . . . , g m2 ) (cf. [U [3 HO]). Consider the sequence of SOS programs: 

rpre 

Jh ■= max 7 

s.t. / -7 = <£ + <t, </> G (h) 2 k, o G Prk{g)- 

If the feasible set if is compact, then {/f re } converges to fmin as tends to infinity 

(cf. E2HE]). 

Theorem 4.1. Suppose the feasible set of 11. 1]) is finite. Let f^ re , / m j n &e as above. 
Then, the sequence {/^ re } has finite convergence to fmin- 

Proof. The feasible set of (jl.ip consists of finitely many real points, say, m, . . . , it/v G 
R ra . Let (fi, . . . ,(fff G R[jc] be the interpolating polynomials such that <fi{uj) = 
for i j and tpi(uj) — 1 for i = j. Then, /(uj) — /min > for all z. Let 

N 

0-1 ■= ^2(f(Ui) - fmin)<Pi- 
i=l 

Then the polynomial / := / — / TO , n — <7i vanishes identically on if. By Positivstel- 
lensatz (cf. [U Corollary 4.4.3]), there exist I G N and 02 G PrN 1 (g), for some JVi, 
such that 

Z^ + ffa G (fc) aJVl . 

For all e > 0, denote 

By Lemma 12.11 the polynomial 

is SOS. Hence, there exists > iVi such that er c G PrN 2 (g) for all e > 0. Let 

e := / - {fmin -e)-a e = -ce 1 " 2 ^/^ + a 2 ) G (/i^. 
Clearly, we have 

/ - (fmin - e) = (T e + e . 

and e G (h)2N 1 for all e > 0. Like before, we can get /£ re = / m i„ for all k > N%, 
which completes the proof. □ 

We conclude this section with an example. 

Example 4.2. Consider the optimization problem 

min —x\ — x\ 

S.t. x\ > 0, ^2 > 0, — X\ — X2 — X\X2 > 0. 

Let /, gi, g 2 , gz be the objective, the first, second and third constraining polynomials 
respectively. The feasible set consists of the single point (0,0), and the global 
minimum is f m i n — 0. Clearly, f£ re < for all k. Denote SOS polynomials: 

Al 4 , 6 , 8\ Ai 4 , 6 , 8\ 
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I 2 2n4 . a , 4 4n2 on r 2 . 2 . 4 . 4 . 6 . 6n 

(To = (X\ — X 2 ) + 0(Xi — X 2 ) , CT12 = A2(x Y + x 2 + x ± + x 2 + x 1 + x 2 ), 

ai = 8(xt(x 2 + 1/2 + 4a;f) + x\(x\j2 + 2x x x 2 + 2x 2 2 ) + 

xf(2x 2 + 1/2 + 2x1) + xi(xl/2 + Xl x 2 + 4x 2 2 ) + si) , 

cr 2 = 8(x!(a;i + 1/2 + 4a;?) + xi{x 2 2 /2 + 2x 2 x x + 2x'l)+ 

xj(2 Xl + 1/2 + 2a;?) + x|(x|/2 + x 2 x x + 4a;?) + s 2 ) , 

□ // 8. 8. 7. 7. 6. 6\ , . 2 2/ 2 . 2. 4. 4. 6. 6n\ 
d"3 = 81 (Xi + X 2 + Xi + X 2 + Xi + X 2 ) + Ax 1 X 2 (X 1 + X 2 + X X + X 2 + Xi + x 2 ) J 



Letting a := <r + gi^i + 92<J2 + 9ig2<Ji2 + 530-3 <E Pr 6 (g), we have 

/ 4 + a = 0. 

This implies that / vanishes identically on the feasible set. For e > 0, let 



By Lemma HHl we know a e G Pr$(g) for all e > 0. Clearly, we have 

/ - fmin + e = ere + 4>t (where 4> e := --^(f 4 + a) = 0). 
Like before, we can get f% re = for all k > 6. 




□ 



References 



[1] J. Bochnak, M. Coste and M-F. Roy. Real Algebraic Geometry, Springer, 1998. 
[2] T. Dube. The structure of polynomial ideals and Grobner bases. SIAM J. Comput. 19(1990), 
no. 4, pp. 750-773. 

[3] J. B. Lasserre. Global optimization with polynomials and the problem of moments. SIAM J. 

Optim. 11(3): 796-817, 2001. 
[4] J.B. Lasserre. Moments, Positive Polynomials and Their Applications, Imperial College 

Press, 2009. 

[5] J.B. Lasserre, M. Laurent, and P. Rostalski. Semidefinite characterization and computation 
of zero-dimensional real radical ideals. Found. Comput. Math. 8(2008), pp. 607-647. 

[6] M. Laurent. Semidefinite representations for finite varieties. Mathematical Programming 
109(2007), pp. 1-26. 

[7] M. Laurent. Sums of squares, moment matrices and optimization over polynomials. Emerg- 
ing Applications of Algebraic Geometry, Vol. 149 of IMA Volumes in Mathematics and its 
Applications (Eds. M. Putinar and S. Sullivant), Springer, pages 157-270, 2009. 

[8] M. Laurent and P. Rostalski. The Approach of Moments for Polynomial Equations. Handbook 
on Semidefinite, Gone and Polynomial Optimization (eds. M. Anjos and J.B. Lasserre), 
Volume 166, pp. 25-60, International Series in Operations Research & Management Science, 
Springer, 2012. 

[9] M. Marshall. Optimization of polynomial functions. Canad. Math. Bull., 46(2003), no. 4, 
575-587. 

[10] M. Marshall. Positive Polynomials and Sums of Squares. Mathematical Surveys and Mono- 
graphs, 146. American Mathematical Society, Providence, RI, 2008. 

[11] M. Marshall. Representation of non-negative polynomials, degree bounds and applications to 
optimization. Canad. J. Math., 61 (2009), pp. 205-221. 

[12] E. Mayr and A. Meyer. The complexity of the word problems for commutative semigroups 
and polynomial ideals. Advances in Mathematics 46 (1982), pp. 305-329. 

[13] J. Nie, J. Demmel and B. Sturmfels. Minimizing polynomials via sum of squares over the 
gradient ideal. Mathematical Programming 106(2006), Ser. A, no. 3, pp. 587-606. 

[14] J. Nie. An exact Jacobian SDP relaxation for polynomial optimization. Mathematical Pro- 
gramming, to appear. 

[15] J. Nie. Certifying convergence of Lasserre's hierarchy via flat truncation. Mathematical Pro- 
gramming, to appear. 



POLYNOMIAL OPTIMIZATION WITH REAL VARIETIES 



13 



[16] M. Putinar. Positive polynomials on compact semi-algebraic sets. Ind. Univ. Math. J. 
42 (1993), pp. 969-984. 

[17] B. Reznick. Some concrete aspects of Hilbcrt's 17th problem. In Contemp. Math., Vol. 253, 

pp. 251-272. American Mathematical Society, 2000. 
[18] K. Schmudgen. The K-moment problem for compact semialgebraic sets. Math. Ann. 289 

(1991), 203-206. 

[19] G. Stengle. Complexity estimates for the Schmdgcn Positivstellcnsatz. J. Complexity 12 
(1996), no. 2, 167-174. 

Department of Mathematics, University of California San Diego, 9500 Gilman Drive, 
La Jolla, CA 92093, USA. 

E-mail address: njwOmath.ucsd.edu 



